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1 Introduction 

The theories of Lyapunov functions and domains of attraction form the basis 
for much of current work in stabihty theory (cf. |21 El IHl El ) • An important 
result in this area is the Zubov method (cf. ^ jUl UHl El)i which gives 
conditions under which the domain of attraction of an asymptotically stable 
fixed point of i = f{x) is u~^([0, 1)), where v is the solution of the Zubov 
equation 

Dvix) ■ fix) = -H{x)[l - v{x)Wl + ||/(x)||2, xeR^ 

for suitable functions H. In 0|H1|S1, Zubov's method was extended to the 
important case of perturbed asymptotically stable systems x = f{x, a) for 
which the fixed point is stable under any perturbation a. These perturba- 
tions, taken to be A := {measurable functions a : [0, cx)) A} for a given 
compact set A, are used to represent uncertainties and exogenous effects, 
rather than controls. The main results in (HI are partial differential 
equations (PDE) characterizations for robust domains of attraction and ro- 
bust Lyapunov functions for perturbed dynamics (cf. i]21below for the relevant 
definitions) . Under the conditions in ^ , the robust domain of attraction Do 
for the perturbed system x = f{x,a) is v~^{[0,l)), where v is the unique 
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bounded viscosity solution of the generalized Zubov equation 

mi{-Dv(x) ■ f(x,a) - g(x,a) +v(x)g(x,a)} = 0, x £ (1) 

that vanishes at the origin, under certain restrictions on g. The solution v 
of is a robust Lyapunov function for the perturbed dynamics /. Also, if 
mild assumptions are added on g and /, then v is locally Lipschitz (cf. ti4.2.2l 
below). The results from j^j form the basis for discrete approximations of 
Lyapunov functions and Do (cf. P). In El Eli the function g in Q is 
assumed to satisfy^ 

(i) M{g{x,a) : X ^ Br,a £ A} > go > 

(ii) g{x,a)>0 V a; 0, V a e A ^ ' 

for some constants go and r. However, one can easily find equations which 
admit several bounded solutions which are null at the origin when |(5J is not 
satisfied. Here is an example where this occurs: 

Example 1.1 Define the functions f,g:Rx [—1, 1] ^ M by 

1- ^, if X < -1, 
f{x, a) := ^ ~x + ax^ , if — 1 < a; < 1, 

2- - 1, if X > 1 



and 

g{x,a) = 7(a;) 




-1 < X < 1 
otherwise 



Then the robust domain of attraction Vo is (—1, +1). Let M. denote the set 
of all measurable functions a : [0, oo) A := [— and Traj^(/) denote 
the set of all solutions : [0, oo) — > R of y = /(y, a) starting at x for a £ M.. 
One bounded solution^ of the corresponding generalized Zubov equation 

\ui{-]{x,a)-Dv(x)]^{v{x)~\)-i{x) = (3) 
on M is = 1 — exp(— Wi), where W\ is the maximal cost function 



W^i(x) =sup|^ 



7((/.(t))di :0eTraj,(/) 



This follows from an elementary consideration of semidifferentials.^ Notice 
that < wi < 1 on M and wi(0) = 0. Other bounded solutions of (jSJ on R 
are 

I wi(x), X > — 1 
'V2{'x) — \ , fc > 1 constant 

fc, X < — 1 



ifir := {x e : ||x|| < r} for all r > 0, where = (x\ + x\ + ... +x\Yl'^. 

^We will understand our Zubov equation solutions to be in the discontinuous viscosity 
sense (cf. ^ Definition IT^. 

^By the arguments of 0, v\ is a solution of jSJ on any interval of the form (—5, +5) 
for 5 g (0,1), since on this interval, v\ is the Kruzkov transformation of a maximal cost 
value function for a cost function satisfying Evidently v\ is a solution of j3J outside 
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As before, 1^2(0) = 0, but W2(— 1) > 1). Notice that vi and 172 are 
continuous at the origin. 

Remark 1.2 Our hypotheses will imply ^^^([O,!)) = Do, where v is the 
unique bounded solution of the corresponding generalized Zubov equation 
that satisfies v{0) = and that is continuous at the origin. One hypothesis 
we will make will be g quasi-stability of M^, which is roughly the condition 
that trajectories on [0, 00) with finite total cost must approach the origin 
(cf. f|2]for the definition of g quasi-stability). In the previous example, this 
condition is not satisfied, since (f>{t) = 1 gives total costs. On the other 
hand, all the other hypotheses of this note are satisfied in this example, which 
shows that our quasi-stability hypothesis cannot be dropped. 

Example ll.ll motivates our study of the solutions of the generalized Zubov 
equation and the sublevel sets of these solutions, for general costs g. This 
note will develop uniqueness theory for solutions of (Q), which includes the 
uniqueness characterizations given in jBj , and also applies to cases which are 
not tractable by the known results, e.g., cases where g is non-Lipschitz or 
violates (01 ■ We also study the regularity of Zubov equation solutions, and 
the sublevel sets of these solutions, under relaxed assumptions on / and g. 
Our results have the following novel features: 

1. Our results are based on extensions of results in |13[ll4[[THlll6[[T7ll21| on 

uniqueness of solutions for the infinite horizon Hamilton-Jacobi equa- 
tion, namely. Theorem ^ and Propositions 13.51 and rTHl in The infi- 
nite horizon equation is the same as the exit time equation. Whereas 
1161 117j assume that the undiscounted infinite horizon Lagrangian 
is nonnegative, our results apply for Lagrangians which could be null 
or negative. It is natural to consider optimization with Lagrangians 
that take both positive and negative values, to allow cost minimization 
in one part of the state space and maximization elsewhere. Results 
on undiscounted exit problems with negative Lagrangians were given 
in which requires controllability to the so-called positivity set of 
the Lagrangian. This controllability condition is not needed below, nor 
do we need the uniform positive lower bounds on the interest rates 
used in |22j . Theorem ^ does not put any growth or lower bound as- 
sumptions on solutions, nor does it require any controllability at the 
origin. On the other hand, the earlier uniqueness characterizations 

[—1, where it is constant. It remains to check the semidifferential condition for vi to 
be a solution of j^J at ±1 (cf. To check this condition at —1, it suffices to check that 

(i) -p - bl < for all p G D+{vi)*{-l) and (ii) -p - |p| > for all p g D- {vi)^,{-l). 
Condition (i) is trivial, while (ii) follows because if p 6 D~ (t)i)* (~1), then 

hlO h 

since {vi)ir{—l + h) < (i)i)*(— 1) for h> near 0. A similar argument applies at This 
argument also shows that the functions 112 we are about to give are solutions of j3J on R. 
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for Hamilton- Jacobi equations (cf. [3 [H [13 CHI [HI ED E21) prove 
uniqueness of solutions in classes of functions which are either proper 
or bounded below by a finite constant, or which satisfy an asymptotic 
condition at the boundary of the domain. Therefore, in addition to ap- 
plying to problems with more general Lagrangians, our results extend 
previous work by allowing more general comparison functions, includ- 
ing functions which are negative and neither bounded-from-above nor 
bounded- from-below. 

2. Our uniqueness theory for Q applies for general functions g, and gives 
stronger conclusions than the uniqueness theory of [51 121 E] ■ Clearly, a 
function w is a solution of exactly when — w is a solution of the usual 
infinite time Hamilton- Jacobi equation ||SJ) with interest rate h = g and 
Lagrangian £ = —g. However, since the usual uniqueness results for © 
require nonnegative £ or strictly positive h (cf. [3|[^[221), these results 
cannot in general be applied to when g is nonnegative. Moreover, 
the known results on |^ (cf. [SJ [HJ [H]) require condition and a 
growth condition such as Lipschitzness for g, and therefore cannot be 
applied to general situations. Since we allow general possibly non- 
Lipschitz costs g, including cases where Q is not satisfied (cf. Remark 
14.91 and our theory can be regarded as an extension of the results 
of [13) on optimal control for non-Lipschitz dynamics. By allowing 
degenerate costs g, we obtain solutions of ^ with properties not found 
in the Zubov equation solutions of (cf. t l4.2.2l and Remark 14. 8|l . The 
unique solutions of are robust Lyapunov functions for /, and are 
the Kruzkov transformations of maximal cost type robust Lyapunov 
functions Vl for /. The functions Vl are in turn unique solutions of 

mU-f{x,a)-Dvix)-g{x,a)} - (4) 

aeA 

on 2?o. This generalizes the PDE characterizations for |^ and in 
[B]. On the other hand, the uniqueness characterizations for and 
Q in JB] all follow from the results given below. Therefore, we obtain 
new classes of 'flat' maximal cost type robust Lyapunov functions, cor- 
responding to degenerate cost functions g, which can be characterized 
as unique PDE solutions (cf. Remark I4.8|l . This leads to new char- 
acterizations of Vo as sublevel sets of value functions for degenerate 
instantaneous costs (cf. Corollary 14. 6(1 . 

This note is organized as follows. In ^ we give definitions and lemmas from 
[31[S|. In we give general uniqueness theory for solutions of infinite horizon 
Hamilton- Jacobi equations. In ^ we apply these results to stabilization, and 
investigate the regularity and uniqueness of solutions of |^ and These 
solutions are shown to be Lyapunov functions with special properties not 
found in the Zubov equation solutions in 6 (cf. t l4.2.2|l . Our results are 
based on recent variations of the Filippov-Wazewski Relaxation Theorem, 
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which we review in Appendix A. In ^ we illustrate our results with an 
example from [S]. We close in ^Hlby discussing extensions and directions for 
future research. 

2 Definitions and Lemmas 

This note is concerned with perturbed systems of the form x = f{x,a), 
x{0) = Xo where the input a represents exogenous effects and uncertainties 
in the design of the control system. As in 6.,, we will assume the following: 

{Ai) A is a nonempty compact metric space. 

{A2) f : X A ^ is bounded and continuous, where is a fixed 
positive integer. Also, f{x, a) is uniformly locally Lipschitz, meaning, 
for each R > 0, there is a constant Lj^ > such that if ||a;||, ||y|| < R 
and a G A, then \ \f{x,a) — f{y,a)\ \ < Lj^\\x — y\\. 

(A3) /(O, a) = for aU a e A. 

In 21 use functions g as the cost functions for greatest cost Lyapunov 
functions, and we use cost functions £, which we will refer to as Lagrangians, 
when we study least cost optimal control value functions in ^ We always 
assume that g and £ satisfy the following: 

{A4) g,£ : R'^ X A ^ R are continuous, ^(0, a) = g{0, a) = for all a e A, 
and g is nonnegative. 

In our main applications, we take £{x,a) < for all (a;, a), but our theory 
applies to general continuous £ (cf. i il-i.2(l . Assumptions {Ai)-{A3) imply that 
for each a E A := { measurable functions a : [0, 00) A} and Xo G R^ , the 
system 

x{t)^ f{x{t),a{t)), x{0)=Xo (5) 

has a unique (classical) solution defined on [0, 00), which will be denoted by 
(j){-,Xo,a), and called the trajectory of / for a starting at Xo- Elements 
of A are called controls or inputs. For any / and A satisfying (Ai)-(A3), 
Traj^^(/) := {<;()(•, Xo, a) : a e A}. 

We sometimes also use the releixed controls A^ , which is the set of all 
measurable functions a : [0, 00) A^, where A^ is the set of all Radon 
probability measures on A (cf. |3j). Recall (cf. |3]) that A"^ is a compact 
metric space. By A^ 9 a„ — > a G A^ weak-*, we mean that for alH > and 
all Lebesgue integrable functions B : [Q,t] C{A), 

lim / /(B(s))(a)d(a„(s))(a)ds= / / (B(s))(a) d(a(.s))(a) ds (6) 

"^°°Jo J A Jo J A 

where C{A) is the set of all real-valued continuous functions on A. For any 
M G N and any function $ : x A ^ R^, we define <^'' :R^ x A'' ^ M*^ 
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by m) := a) dm{a). Notice that {Ai)-{A3) hold with / replaced 

by and A replaced by A'^ . We also use </)(•, a;, a) to denote the solution of 
y — f^iUj'^) defined on [0, +00) starting at x for each a . Therefore, 
Traj^(/'') = {(j){-^x,a) : a G A^}. This extends our original definition of (p, 
since we can view A as the subset of A^ consisting of all Dirac probability 
measure valued relaxed controls. When a G A^, we call x, a) the relaxed 
trajectory of / for a starting at x. Recall the following Compactness Lemma 
on relaxed controls (cf. 

Lemma 2.1 Let {Ai)-{A2) hold, let {a„} be a sequence in , and let c > 0. 
Then there exists a subsequence of {a„} (which we do not relabel) and an 
a IE A^ such that (i) an a weak-* on [0, c] and such that (ii) if a;„ ^ a; in 
, then (/)(•, Xn, an) — > 4>{-, x, a) uniformly on [0, c]. 

We sometimes also use a function h, representing a discount rate, which 
we always assume satisfies 

(^5) ft, : X ^ [0, +00) is continuous. 

We say that / is uniformly locally asymptotically stable (ULAS) 

provided that 

(^) There are f3f € ICC and r > such that ||(/)(t, x, q;)|| < l3f{\\x\\,t) for 
all X £ Br, t > 0, and a E A. 

and that / is uniformly locally exponentially stable (ULES) if {-k-k) 
holds for f3f{s, t) = Cse^'^* for some positive constants C and When / is 
ULAS, we set i(a;, a) inf{i > : a;, a)| | < r} for aU {x,a) G x 
where inf is defined to be +00. Also, 



We call V the domain of attraction of /, and Vq is called the robust 
domain of attraction of /. As shown in 6 , the sets V and may differ 
for ULES dynamics satisfying (Ai)-(A3). Since relaxed trajectories of / can 
be uniformly approximated by trajectories of / on compact intervals without 
changing the initial value, one shows that if / is ULAS, then so is . For each 

''Recall (cf. that /C°° is defined to be the set of all strictly increasing functions 

F : [0, 00) [0, Qo) which satisfy (i) F(0) = and (ii) F{x) +00 as x ^ +00. Also, KC 
is the set of all continuous functions /3 : [0, 00) X [0, 00) — > [0, 00) for which (i) l3{-,t) g K°° 
for all t > 0, (ii) /3(s, ■) is decreasing for all s > 0, and (iii) /3(s, i) as t — » +00 for all 
s>0. 




and 



o 



x E K. : sup t{x, a) < +00 
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open set G Q let C^{G) denote the set of all continuously differentiable 
functions F : Q ^ R. For each 5 C M^, we set 

Wi,{x) — Ihnmi w{y) and w'^{x) = \imsupw{y) 

SSy^x S3y^x 

for all a; G 5 and locally bounded functions w : — > M. Then w^, is lower 
semicontinuous and w* is upper semicontinuous. Also, Wi, = w* — w at all 
points of continuity of w. We will find conditions under which the general- 
ized Zubov equation 

inf {—Dv{x) ■ f{x, a) — g{x, a) + v{x)g{x, a)} = (7) 

has a unique bounded continuous solution v on that satisfies the two 
conditions w(0) = and -^"^([0, 1)) = V^. Also, we consider solutions of 

sup{— /(x, a) ■ Dv{x) — £{x, a) + h{x, a)v{x)} — (8) 

aeA 

which we refer to as the infinite horizon Hamilton-Jacobi equation (for 
the dynamics /, Lagrangian i, and interest rate h). Since solutions of HI)-® 
may not be differentiable or even continuous (cf. J:), we consider solutions 
of these equations in the viscosity sense, by which we mean the following: 

Definition 2.2 Let C be open, S ^ G, F : x R x ^ R he 
continuous, and w : 5 — > R be locally bounded. We call w a (discontinuous 
viscosity) solution of F{x,w{x), Dw{x)) = on G provided the following 
two conditions hold: 

(Ci) If 7 e C^{G) and G is a local minimum of Wi, — 7, then 
F{xo,Wi,{xo), Dj{xo)) > 0. 

(C2) If A G C^{G) and xi G ^ is a local maximum of w* — A, then 
F{xi,w*{xi),DX{xi)) < 0. 

Let 50(5) denote the closed convex hull of any set S C R^^. We will set 
^(x,A) := {$(a;,a) : a G A} for all $ : R^ x A ^ R^^ and c\{S) (resp., 
comp(5')) will denote the topological closure of S (resp., R^ \ S) for each 
S C R^. For any function ^E" : R^ — > [— cx),+cx3], we define the (effec- 
tive) domain of ^ to be dom(^') = {x G R" : *(a;) G R}, and we define 
Trace(5') := {'^{t) : t G dom(*)}. Also, d{B) denotes the boundary of any 
set B C R^, and Null(i^) := {x : F{x) = 0} for any real- valued function 
F. A set C R^ will be called (strongly) invariant with respect to / 
(or /-invariant) provided the following holds: If a; G 5, then 0(i) G G for all 
t > and (j) G Trajj.(/). An open /-invariant set O containing the origin is 
called asymptotically null (for /) provided the following holds: If a; G O 
and (f) G Traj^(/), then (pit) ^ as t — > -foo . One can show that Vo is 
asymptotically null for / when / is ULES. Moreover, we have the following, 
whose proof is in |S]: 
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Lemma 2.3 Let / be a ULAS dynamics satisfying {Ai)-{A3). Then: 

a) c\{Br) C Vo, and V C cl(Po). 

b) Vo is open and asymptotically null for /. 

c) If f{x, A) is convex for all x G M^, then T> = Do- 

For each x G M^, a G y^*", and h and £ satisfying {A4)-{Ac,), we set 



h{x,t,a) :— / /i''((/)(s, X, a), Q!(s)) ds 
Jo 

and ^ 

J[^,/i](x,t,a) / e-'*(^''*'")r((/)(s,x,a),a(s))ds 
Jo 

For cases where h = 0, we use J[^] to signify J[£, 0]. We also set 

dist(p,S') = inf{||p-s|| -.seS} 

and Br{S) := {x e : dist(x,S') < R} for each R > 0, p e M^, and 
S C R^. When S = {x}, we write BB.ix) instead of ^^({x}). The following 
lemma follows from the proof of Theorem in.2.32 in 3 : 

Lemma 2.4 Let {Ai)-{A5) hold, and w be a solution of (jSJ on a bounded 
open set B CR^. Define Tg : A ^ [0, oo] and T5 : ^ [0, 00] by 

r,(/3) = inf{t>0: ^it,q,f3) G dB} 

Ts{p) - M{t > : (f,{t,p, a) G ^^(aB), a G ^} 

for each q € B and (5 > 0. Then: 

(a) For all q G B, /? G A, and r G [0,T5(/3)), 



Jo 

(b) For all g G 5, <5 G (0, dist(g, aS)/2), and t G [0,T5(g)), 



w*((Z) > inf 



t 

e-''(«'"^"V(0(s,g,a),a(s))ds 



A function : O ^ M on an open set O C is called a robust Lyapunov 
function for / provided (i) V is positive definite (meaning, V{x) > for all 
x, and V{x) = iff a; = 0) and (ii) V{x) > V{<p{t, x, a)) for all x G O \ {0}, 
t > 0, and a E A. An open set O C R^ is called g quasi-stable (resp., 
relaxed g quasi-stable) provided the following condition holds for each 
x € O: If a G -4 and x, a), di < 00 (resp., a ^ A^ and 

/o°° 9^{4'{t^ 2;, a), a{t)) dt < 00), then limj^+oo (/)(t, x, a) = 0. 
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Remark 2.5 If we drop the assumption that / is bounded but keep the other 
hypotheses in (Ai)-{A3) the same, then ^ has a unique solution (f>(-,Xo,a) 
defined on a maximal interval [0,6), with b > depending on Xo and a d A. 
Recall that if ^ is a compact metric space, then a uniformly locally Lipschitz 
function / : x A ^ (cf. {A2)) is called forward complete provided 
that the solution (l){-,Xo,a) for © is defined on [0, cxo) for all Xo G and 
a € A (cf. p,2.). Assumption {A2) implies that / is forward complete. As 
mentioned in it is not very restrictive to assume that / is bounded, since 
we can replace / by //(I + 1 1/| |) without changing the trajectories. However, 
normalizing in this way changes the design of the control system. If we change 
{Ai)-{A3) by replacing the boundedness of / with the assumption that / is 
forward complete, then TZ'^{S) :— {(j){t,x,a) : < t < T, x e S, a £ A} is 
bounded for each T e [0, 00) and bounded set C (cf. ^). Using this 
fact, one can show that all results in this note remain true if the boundedness 
of / is replaced by the forward completeness of / (and the other hypotheses 
are kept the same). The system / will be forward complete if, instead of 
assuming / is bounded, we assume f{x, a) is globally Lipschitz in x uniformly 
in a (cf. [3 ). 

Remark 2.6 It will not be necessary to assume that the sets f{x,A) are 
convex. Instead, we will instead apply Lemma lT^ cl to the relaxed dynamics 
: X A'' ^ R^, using the fact that f{x, A'') = co{f{x, A)) is convex for 
all X e R^. In we study solutions of (|SJ on general asymptotically null 
sets, including non-ULAS / (cf. 9 , p. 191, for an example due to Vinograd of 
asymptotically null sets for non-ULAS dynamics, with no controls, in which 
each trajectory asymptotically approaches the origin). 

Remark 2.7 By the Filippov Selection Theorem, relaxed g quasi-stability 
and g quasi-stability are equivalent if (/ x g){x, A) is convex for each x G R^ 
(cf. §VI.l). For sufhcient conditions for g quasi-stability for cascade 
systems, see [161 117| . Notice that both forms of g quasi-stability hold for all 
choices of g if O is asymptotically null for /''. Also, both are satisfied for 
O = and ULES / if © holds for the constant r in the ULES definition. 
Since A C A^ , relaxed g quasi-stability implies g quasi-stability for any open 
set. In some applications, we also assume g is uniformly locally Lipschitz (cf. 
{Aq) in 21below), in which case g quasi-stability and relaxed g quasi-stability 
are equivalent conditions for any open O C R^ (cf. Appendix A below). 

3 Results on Infinite Horizon Problems 

To develop Lyapunov theory for ULAS dynamics, we first study the infinite 
horizon value function 



Voo{x) := inf J[£, h]{x, +00, a) £ [— 00, -t-oo] 



(10) 
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with the conventions that (i) the infimum is only over those a for which 
J\l, h\(x, +00, a) converges in RU{±cx)} and (ii) inf = +cx). Our results on 
(jTU)) will be of independent interest, because we will allow general continuous 
unlike the usual results, which assume that £ > everywhere, or that h is 
uniformly bounded below by a positive constant (cf. the remarks following 
the proof of Theorem ^ for a comparison of our results with the known 
results). Since minimization of a function F is equivalent to maximizing —F, 
this allows problems where minimization takes place in the part of the state 
space where £ > 0, while maximization takes place elsewhere. We will refer 
to the side condition 

(SCw) w(0) = 0, and w is continuous at the origin 

In particular, (5C^) imphcs that w^(0) = w*{^) — 0, and that for each £ > 0, 
there exists a (5 > for which w*(p) < e and w^,{p) > —e for all p ^ Bs- 
We will use this information in the proofs of Theorem ^ Theorem |21 and 
ProDOsition lA.2l below, to account for the case where w is discontinuous. 

3.1 Problems with Negative Lagrangians 

We begin with the case of nonpositive £, in which case (|10|l involves the 
maximization of J[—£,h]. For the extension to general Lagrangians, and to 
sets which are not asymptotically null, see Remark l3. II and ^'3.2\ Notice that 
Voo might not be continuous or even locally bounded, and so not a solution 
of © (cf. RemarkO with A = {+!}). Nevertheless, we have the following 
local comparison result, whose statement and proof actually cover the cases 
where i is everywhere nonpositive or everywhere nonnegative: 

Theorem 1 Assume the following: 

(1) {A^),{A2), {Ai), {A,), Null(||/(O,.)||)y^0. 

(2) Q Q M.^ is asymptotically null for f. 

(3) Either £{x, a) < for all {x, a) G x A, or else i{x, a) > for all 
(x,a) e X yl. 

(4) w : Q R is a solution of 0) on Q\ {0} that satisfies [SCw). 
Then w = Voo on Q. 

Proof. We assume /i = 0. The proof of the general case is similar to the one 
we will now give. Let x ^ Q\ {0} and e > be given. It suffices to check that 
w*{x) < 1^00(2;) and > Vcoix), since < w* on Q. To do this, first 

note that J[£](a;, +00, a) converges in RU {icxo} for all a G .4, by hypothesis 
(3). If a € ^, then Lemma the asymptotic nuUness of G, and (SCw) give 



w*{x) < limsup / £{(j){s,x,a),a{s))ds + w*{(j){t,x,a)) 




< J [£]{x, +00, a) + lim sup w* {(flit, x, a)) < J[£](a;, +00, a) 



t — ^+00 
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so w*{x) < Voo{x) follows by infimization. Let e > be given. It remains to 
construct a d A such that 

■w^{x) > / e{(l){t,x,a),a{t))dt + w^,{(j){M,x,a)) ~ e VM e N (11) 
Jo 

Since Wi, is lower semicontinuous and G is asymptotically null, a passage 
to the liminf as M +oo and an infimization in lll|l would then give 
w*ix) > Voo{x) — e. Since e was arbitrary, we would get Wi,{x) > Vocix), as 
needed. We will now construct an a satisfying (|ll|l by adapting ideas from 
|l()l I17j . We will assume that w is continuous on Q, the general case being 
exactly the same but with w^, replacing w. Define i?2, . . . by 

Ej{t) = e [e-(^'-i) -e-(*+^'-i) 1 for each t > (12) 

By the choice of the i?j's, 

Ei{l) + E2{1) + ... + E,^{1) = e{l - e-™) 
for all m G N. Set 



(i, a) e [0, 1] X ^ : w{x) > i{<l){s, x, a), a{s)) ds 
+w{(j){t,x,a)) - Ei{t) 



The proof of the theorem in jl7| . which we review in Appendix A, shows 
that Zi contains an element of the form {\,cS^^). Set 

ci=a«, 7(0) =5, 7(1) = '^(l,S,ci). 

Next, we will inductively define the sets 



(13) 



(t, a) e [0, 1] X ^ : wm)) ~ w{cj){t, a)) > 
Jq ^('/'(s, a), a{s)) ds - E^+i{t) 

Reapplying the argument from |17| . we inductively obtain 

(l,a«)GZ, and 7(* + 1) := 0(1, 7(*), «'+') e ^ 

for all i e N. We inductively let q+i be the concatenation of Ci \[0, i] followed 
by Now sum both sides of the inequality in (|13|l . with the choices 

a = and t ^ 1, over i — 0, 1, 2, . . . , M — 1. Since 

M-l 

J[^](7(0,l,«*+') = ^M(S,Af,CAf) 

1=0 

for all M e N, the choices of the Ej's give (QlJ, with a{t) := Cj{t) for 
0<t<j. I 



12 



Michael Malisoff 



Remark 3.1 Notice that no growth conditions were required for nor were 
there any requirements on the rate the trajectories approach the origin. In 
particular, we allow non-Lipschitz I and unstable / (cf. Remark l2.(j|l . Condi- 
tion (3) on I in Theoremnwas used to force the integral in to converge 
in R U {±oo}. However, for general J[P\ (a;, +00, a) may not converge in R. 
This occurs if for example 

iv = i, leA I{x,i) = -x\ 

h = 0, i{x, a) = \x\, a = 1 

in which case 

J[e]{l,M,a)= {l + 2t)-^/^dt, 
Jo 

which does not converge in R as M ^ +00. A different way to guarantee 
convergence of the costs is to replace Condition (3) in Theorem ^ with one 
of the following: 

(A) £ is bounded, 3ho > s.t. h{x, a) > ho V(x, a) G R^ x A. 

(B) \£{x,a)\ < h{x,a) V(a;,a) e R^ x A. 
In case (B), we get 

J[\£\j h]{x, +00, a) < J[h, h]{x, +00, a) = 1 — exp {—J[h]{x, +00, a)} < 1 

for all X e R^ and a A. For case (A), uniqueness characterizations for (jSj) 
are known (cf. [^I, Chapter III). On the other hand, since we allow general h 
and £, case (B) is not covered by the usual uniqueness results. In both cases, 
J[£, h]{x, +00, a) G R for all x £ Q and a £ A and the argument we used to 
prove Theorem n applies. Further extensions of Theorem ^ are given in t |3.2l 

Remark 3.2 If we add the assumption in Theorem ^ that / is ULES, then 
the part of the proof of Theorem ^ showing that w*(a;) > Vca{x) can be 
simplified to the following. First assume £(x, a) < for all x € M.^ and a € A. 
Let r be as in the ULES definition, let e > be given, and choose S E (0, r) 
such that > ~f for all p € Bs (using the lower semicontinuity of and 

{SCw)). For convenience, we will assume that the constant C in the ULES 
definition is 1, but a similar argument to the one we will now give applies if 
C > 1, by considering small overshoots. By (★*) (with /3/(s,t) — se^°"* for 
suitable a > 0), is then /-invariant. Set 

t(p, /i, a) = iid{t > : | |(/)(t,p, a)\\ < /i} 

for all p € G, fJ- > 0, and a £ A, and let M C Q be an open neighborhood of 
X. If 

T :— sup{T(a;, S,a) : a £ A} — +00, 
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then by Lemma III. 2 from [50], there exist q G JV and (3 G A such that 

r(g,V2,/3) = +^. 

This contradicts the asymptotically nuUness of Q. It follows that T < oo. By 
the convergence of all costs J[£]{x, +oo, a), it suffices to show that 

2 f {t,a) e [0,f] X A : Wi,{x) > i{(l){s,x,a),a{s)) ds 

^ 1 +w40(^,x,a))-|(l-e-*) 

contains a pair (T, a), since then 

Wi,{x) > Voc{x) - £. 

The proof that -Zy contains such a pair is similar to the argument of the 
theorem in |17j (cf . Appendix A below) . A similar simplification can be made 
if, instead of assuming that i is nonpositive, we assume < -^(a;, a) < \ \x\\ for 
all (x, a) (which implies that Voo is continuous at the origin). 

Remark 3.3 Whereas the results of ^Jj assume the controllability condition 
STC{0} to the origin (cf. |3j), the previous theorem does not require any 
controllability. For example, it applies to the ULES dynamics 

f{x, a) = {-xi,-X2) + a{xl,xl), A = [-1, +1], 

on ^ = (—1, +1)^, where STC{0} is not satisfied. In the usual PDE charac- 
terizations for lO (cf. PlEl^^EDi one also assumes that the comparison 
functions w are either bounded-from-below or that w{x) — » +00 as x ^ dG- 
However, these assumptions are not needed in Theorem ^ Therefore, The- 
orem n can be regarded as an extension of the earlier results which takes a 
larger class of possible dynamics and solutions into account. 

Remark 3.4 Note that it was not necessary to assume any uniform bounds 
on the Lagrangians. A uniform positive lower bound on ^ or ft, is needed 
in the uniqueness characterizations of 3., 3j _21, . Therefore, Theorem ^ also 
extends the earlier results by allowing more general Lagrangians and interest 
rates. Recall that 14© may not be locally bounded (cf. Remark 13.11 with 
A = {-1-1}). However, the arguments of [Sj establish that if {Ai)-{A4) hold 
with / ULES, h = 0, and £ = —g for g uniformly locally Lipschitz (cf. (Ag) in 
^below), then w — Voc is a solution of (jS)) on Do that satisfies (SCw)- Since 
Do is asymptotically null for /, TheoremQlthen gives a PDE characterization 
for Voo on T>o. 

3.2 Problems with General Lagrangians 

By combining the arguments of Theorem ^ with |17| , the following variant 
of Theorem n is easily shown: 
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(2) I is nonnegative, Q C is I quasi-stable and /-invariant. 

(3) w : ^ M is a bounded-from-below solution of ((SI on \ {0} that 
satisfies {SCw)- 

Then w = Voa on Q. 

Proposition 13.51 applies to the Fuller Example data from ^1^] on 5 = 

(in which iV = 2, A = [-1,-hl], /i = 0, /(a;, a) = (2:2,0), i{x,a) = [xip, 
7 > 1), which is not tractable by means of the usual results on first-order 
viscosity solutions. For a discussion of this application, see ^l^lEI- (For 
a different uniqueness characterization that applies to the Fuller Example, 
as well as to other examples in which the quasi-stability condition in (2) of 
Proposition 13 . 51 is not satisfied, see |15|.) 

The nonpositivity of i in Theorem ^ was used to guarantee that the total 
cost J\l,h\(x^ +00, a) for the constructed input d converged in MU {icxj}. 
This convergence is implied by (l)-(3) in Proposition 13. 51 A totally different 
approach to guaranteeing this convergence, which allows general continuous 
£, is as follows. Set 



with the same conventions (i)-(ii) used to define Vao in pOjl . 

Proposition 3.6 Assume (^A\)-(^A^) hold and Q is asymptotically null for 
/'". Let w : ^ M be a continuous solution of l|SJl on \ {0} satisfying 
w(0) = 0. Then w = V^oj^ Q. 

Proof. We show how to modify the proof of Theorem ^ We again assume 
h = 0, the general case being handled in a similar way. Let x G Q \ {0}. For 
each e > 0, there exists (1, a^) £ Zi such that 



with the last inequality following from the first part of Lemma |2.4I Using 
Lemma 12.11 with c = 1, we can find a subsequence of the a^'s (which we 
do not relabel) and (3 G such that (i) a£ — > /3 weak-Tk- on [0, 1] and (ii) 
max{||(/.(t,i,ae) - 0(i,x,/3)|| : < i < 1} -> as e j 0. Since G is f- 
invariant, it follows that (j){t, x,f3) € Q for all t G [0, 1]. Letting e J, in lfT3|) 
and using the continuity of w now gives 



V^{x) :^ inf J[£,h]{x,+(x,a) G [— cx), -l-oo], 



(14) 




Jo 

+ w((/)(l, X, Qfe)) — e > w{x) — e 



(15) 



w{x)= [ r(0(s,x,/?),/?(s))ds + u;(<?!)(l,x,/?)) 
^0 
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The proof of the preceding equahty is based on the continuity of the maps 
a I— > (.{x, a) for all x, and is similar to the argument in the appendix of |13| . 
This procedure is iterated and gives a G such that 

I'M 

w{x)^ r((/)(s,x,d),a(s))ds + w(0(Af,S,a)) VM G N (16) 



Since G is asymptotically null for and w is continuous, w{4>{M, x, a)) — + 
as M ^ +0O. This implies that the integral in converges in R as 
M +c«, so gives w(a;) > V^{x). The proof that u;(a;) < V^{x) is 
similar to the proof of the corresponding inequality in the proof of Theorem 
n with A replaced by A^ , since (cf. 

sup{— /""(x, a) ■ p — £^{x, a) : a G A^} = sup{— /(x, a) ■ p — £{x, a) : a G A} 

for all X G R^. I 

Remark 3.7 In some applications, we will take / ULES, h = 0, and £ — —g 
for uniformly locally Lipschitz g (cf. (Ag) below). In this case, Voo is a 
continuous solution of ^ on \ {0} (with h = 0), where is the robust 
domain of attraction for : x A^ ^ R^.^ Proposition 13 . 61 then implies 
that Voo = on V^. We will show below that we in fact have Voo = on 
all of Vo, since Vo = T)^. 

4 Properties of Domains of Attraction and 
Lyapunov Functions 

Our cost function g gives rise to value functions, which we denote by Vl, 
for infinite horizon cost maximization (cf. CHJ)- In this section, we add 
hypotheses on g which imply that Vl is a robust Lyapunov function for /, 
and that Vl is a unique solution of the PDE Q. We also give PDE char- 
acterizations for Do- Regularity for Vl is covered in i)4.2l In particular, we 
show that by removing the positive lower bound assumption |(5J on we ob- 
tain Lyapunov functions with special properties not found in the Lyapunov 
functions of jHIHlEI- In ^4.31 these results are used to give uniqueness charac- 
terizations for solutions of the generalized Zubov equation J^l, giving a new, 
more general class of robust Lyapunov functions which can be characterized 
as unique solutions of generalized Zubov equations. 

4.1 Domains of Attraction 

To study Po, we first consider the auxiliary PDE 

inf {-/(x, a) ■ Dv{x) ~ g{x, a)} = (17) 

ggA 



^Recall that the relaxed domains of attraction are defined in the following way: 25'" 
a; e K'^ : lim </>{*, o) = Va G i , and := { x <^ : sup t{x, a) < +oo I . 
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under hypotheses {Ai)-{A4). It is immediate from the definition of viscosity 
solutions that a function w is a viscosity solution of (|17|l on an open set O 
exactly when —w is a viscosity solution of JSJ on O, with the choices i = —g 
and h = 0. Equation ^ is the usual Hamilton- Jacobi equation, which was 
studied for general nonnegative i in ^13. .14 . However, it will be convenient 
for our applications to assume that g is nonnegative, so the earlier uniqueness 
results on JSJ for nonnegative i and h = would not apply. Instead, we study 
(|17(l using the theory of the previous section. We set 

yL(a;) = sup J[g](a;,+oo,a) e [0,+oo], a: G (18) 

aeA 

We sometimes write VL[g] instead of Vl, to emphasize the cost function g. 
If (Ai)-(A4) hold with / ULES, and if 

3 C, A > s.t. g{x,a) < C\\x\\^ for all x € Br a.nd a € A (19) 

then the argument of [H] shows that VL[g] is locally bounded on T>o (i.e., 
sup{VL(a;) : x £ K} < oo for each compact set K C Vo). Moreover, if g 
satisfies the stronger condition 

(Aq) For each R > 0, there exists a positive constant Lg,_R such that 
\g{x,a) - g{y,a)\ < Lg^jf}\x - y\ \ for aU x,y ^ Br and a ^ A. 

then Vl[.9] is continuous on Vo (cf. 6 ). The following theorem extends the 
uniqueness result in 0, Theorem 3.9, to the case of general nonnegative cost 
functions: 

Theorem 2 Assume {Ai)-{Ai) and JT^) hold and f is ULES. Let O CR^ 
be a g quasi-stable set containing the origin, and let w : O ^ R be a bounded- 
from-below solution of jJ7| ) on O satisfying condition (SC^) and w{x) — > +oo 
as X —^ Xo for all Xq G dO . Then O = V^, and w = Vl on "Do- 
Proof We can assume that w is continuous on O. (Indeed, in what follows, 
we do not use the full strength of the continuity of w. Instead, we only use the 
lower semicontinuity of Wi, and the upper semicontinuity of w*.) As already 
noted, —w is a solution of (jHJ with £ = —g and h = on O. It follows from 
Lemma and the boundary behavior of w that O is /-invariant. Indeed, if 
x G O and a dz A, and if t is the first time (t>(t, x, a) e dO, then we can apply 
the first part of Lemma f2. 41 to ©, with q — x, £ — —g, h = 0, and /3 — a, 
and with bounded open sets B CO containing Trace((/)(-, x, a) [[0, t — l/jTi]) 
for m G N, to get 

—w{x) < — J* g{4>{s, X, a), a{s)) ds — w{(f>{t — 1/m, x, a)) — oo 

as TO ^ -|-C!0, which is a contradiction. Also, the first part of Lemma 12. 41 and 
the invariance of O then give 

w{x) > / g{(f>{s,x,a),a{s)) ds + w{4>{t,x,a)) (20) 
Jo 
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for all a G A, X € O, and t > 0. Since w is bounded-from-below and g 
is nonnegative, (pn|l gives J[g]{x, +00, a) < 00 for all a G ^ and x & O. 
The g quasi-stability of O and Lemma [2.31 therefore give O C I? C cl(2?o). 
Since O is open, O C Do- Since is asymptotically null for / and O is an 
open invariant set containing the origin, O is also asymptotically null for /. 
Therefore, Theorem ^ (with the choices £ = —g and h = 0) gives w = Vl on 
O. Therefore, ^^(x) -> +00 as O 9 x ^ Xo for all Xo e dO. Bv (P)l. 
is locally bounded on 2?o, so we conclude that Do n dO = 0. Recall that O 
contains a neighborhood of the origin. If po G'Do \ O, then the asymptotic 
nullness of Vq gives a point pi € T>o D dO, namely, the first point on a 
trajectory for / starting at po and approaching the origin that lies in dO. 
This contradiction gives Q O and completes the proof. I 

Notice that any open set O C is g quasi-stable if (i) / is ULES 
and (ii) g satisfies ^ for the constant r in the ULES definition, which is 
the lower bound requirement in [H E] . Therefore, the uniqueness results 
for l|17|l given in |H| all follow from Theorem El Moreover, the comparison 
results for 117|l given in 6 also require the comparison functions w to be 
proper (meaning w{x) +00 as — > 00) and {Aq). Therefore, Theorem 
121 extends the uniqueness results in |S] by taking a more general class of 
comparison functions into account. Moreover, Theorem 13 applies to more 
general g, including non-Lipschitz g that do not satisfy lO (cf. SJSJ. If (^1)- 
{A4) and (Aq) hold, with / ULES, then Vl is a continuous solution of 1)17(1 
on Vo by arguments in _f3_ , so Theorem (21 gives PDE characterizations for 
Vl and Vq if Vl{x) +00 a.s x ^ d{T>o)- Sufficient conditions for this 
boundary behavior of Vl will be given in the next subsection. 

4.2 Further Properties of Vl 

In this section, we study the behavior of Vl near d{'Do) and the regularity of 
Vl- If we assume {Ai)-{A4) and {Aq) with / ULES, and if we also assume 

(Ar) g{(j}{s, X, a), a{s)) ds > for aU x G Po \ {0}, t > 0, and aeA 

then Vl is a robust Lyapunov function for / on Do- Indeed, the dynamic 
programming methods from give 



for all X e T>o, which gives Vl{x) > VL{4'{t, x, a)) for all x eVo \ {0}, t > 0, 
and a G A, as needed. Since Lyapunov functions form the basis for much 
of current work in stability, this motivates our study of further properties of 
Vl- Notice that (Af) is weaker than lO (cf. Remark |4.9I and i^l below for 
examples) . 




Vi > (21) 
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4.2.1 Boundary Behavior of Vl 

We will assume {Ai)-{A4) and {Ae)-{Ar), with / ULES, throughout the 
remainder of this subsection. We first look for conditions under which 

Vl{x) +00 as X ^ Xo for all Xo G d['Do) (22) 

Condition (|22|l clearly holds if there is a function w satisfying the hypotheses 
of Thcorcm|21 In 0, 17 is assumed to satisfy (jJI, which implies 1221) . because 
^Lix) > go[sup„ t{x, a)] +00 as X ^ d{'Do)- More generally will hold 
if we add the assumption 

{Ag) is g quasi-stable 

We say that g satisfies the standing hypotheses if {Ai)-{A4) and (^6)-(^8) 
hold. We now show that H22(l holds under the added hypothesis {A^). Set 

VI {x) — sup J[g]{x,^Go,a) G [0, +00] 

We sometimes write Vl\g] instead of V^, to emphasize the cost function g. 
Recall (cf. that (|17|l has exactly the same set of solutions on any open 
set as 

inf {-r{x, a) ■ Dv{x) - g'{x, a)} = 0, (23) 

and that V[ is a continuous solution of (|23|) on V^, by |Bj. Recall that /'' 
is ULES. By Lemma lOl we know that is open and that = , by 
the convexity of the sets f^{x,A'^). Notice that (Ag) and the equivalence of 
g quasi-stability and relaxed g quasi-stability (cf. Appendix A) imply that 
dom(y£) C V. Therefore, dom{V[) = since V[ is finite on (cf. 0). 
By Theorem El JSl will follow if 

yEi^) +00 as x^Xo for all Xo e d {V^) , (24) 

since then we can take w — V[ and O = in Theorem El and conclude that 
VI = Vo and ¥[ = Vl on Vo- We wiU now prove if^ . 

Suppose that a;„ ^ € d{V^^), but that there exists K such that 
Vl{xn) < is: < 00 for aU n. Fix a e yl'' and M > 0. Set 

Sm ^ Bi{{<l){t,Xo,a) -.0 <t < M}), 

and choose F > such that ||/(a;, o) — /(y, a)|| < — y|| for all x and y 
in Bi{Sm) and all a G A. There exists an Nm G N such that 

Mt,Xo,a)-q^{t,x,„a)\\ < e*^| |x„ - x^j | Vt G [0, M], Vn > TVa/, (25) 

and such that (/)(t, a;„, a) G Sm for all t G [0, M] and all n > Nm- This follows 
from Gronwall's Inequality and a generalization of standard estimates from 
[3. By enlarging Nm, we can guarantee that 

\\xn-Xo\\ < TjT^^e-^'^^ yn>NM (26) 
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where \g{x,a) — g{y,a)\ < g\\x — y\\ for all x,y d Bi{Sm) and a £ A. 
Combining if^ and it^ . 

/(0(t,a;o,a),a(t)) < /(0(t,x„,a),a(i)) + 1/M Vn > A^a/ (27) 

a.e. i e [0,M]. Wc can integrate ij^ZI) to get 



Letting Af — * +cxd in (|28|) for fixed a, and using the equivalence of g quasi- 
stability and relaxed g quasi-stability, we conclude that Xo G 'D^ ■ Recalling 
that f'^{x, A^) is convex for all x, Lemma ir^ c) gives Xo G P^, which contra- 
dicts the fact that is open. The following proposition summarizes these 
observations: 

Corollary 4.1 Let {Ai)-{Ai) and {Aq)-{As) hold with / ULES. Then Vl 
is a robust Lyapunov function for / on Do which satisfies (|22ll . Moreover, 
Vo = VI, and Vl = V[ on Vo. 

Remark 4.2 Under our standing hypotheses, 



which is weaker than the condition dom(VL) ~ V^- Later, we show that 
under {Ai)-{As), we do in fact have dom(VL) — Vo- Our hypotheses are 
weaker than (|2J), since (Aj) allows vanishing and asymptotically decaying 
costs g (cf. 14 , and Remark l4.9l and ^S] below). For the study of the case 
where Q holds, see H El ■ Notice that {Ai)-{As) imply that is 
also relaxed g quasi-stable (cf. Appendix A). Also, the proof of H22|l remains 
valid if (^s) is relaxed to the requirement that there be a g quasi-stable set 
containing cl(2?o). 

Remark 4.3 Under the additional hypothesis (O, VL[g] is proper (cf. [HI). 
However, under the standing hypotheses on g, VL[g] may not be proper. For 
example, we can take 



in which case VtisKa;) 7''/2 as x ^ +oo. 
4.2.2 Lipschitz Lyapunov Functions 

It is natural to look for conditions under which the Lyapunov function Vl is 
not only continuous on Pq, but also locally Lipschitz on Pq. It is also natural 
to ask whether the function 



J[g]{xo, M, a)<K+l Va G X, M > 0. 



(28) 



Vo C dom(VL) C P C cl(Po), 



A^=l, g{x) = \x\/{l+x'^), and /(x, a) = -x, 



W5 := 1 - e 
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is globally Lipschitz for large enough fixed 5 > 0, because vs{x) ^ 1 as 
6 +00 for each fixed x G Vo \ {0}. Later, we will show that vs is a robust 
Lyapimov function for / on Do for each fixed ^ > 0, and that it is a global 
solution of the Zubov equation for suitable g. The question of whether vg is 
globally Lipschitz for fixed S > therefore reduces to the question of whether 
the methods of the previous section can produce globally Lipschitz Lyapunov 
functions and globally Lipschitz solutions of The proof of the following 
is the same as the proofs of Proposition 4.2 and Proposition 4.3 in ^^6,: 

Proposition 4.4 Let {Ai)-{A4) and (AeyiAj) hold with / ULES, and as- 
sume the following: 

(L) There are c, k > and s > Lr/cr such that for all x,y G Be and a G A, 

\g{x,a) -giy,a)\ < Kmax{||2;||M|y||^}||a; - y||, 

where r and a are the constants in the ULES definition and Lr is the 
constant from (^2). 

Then Vl is locally Lipschitz on T>o- If in addition there are e (0, scr) and 
Lg > such that 

\\f{x,a) ~ f{y,a)\\ < Lf\\x - y\\ and \g{x,a) - g{y,a)\ < Lg\\x - y\\ (29) 

for all x, y e and a G A, and if (O holds, then vs is globally Lipschitz on 
M.^ for all sufficiently large (5 > 0. 

The proof of the global Lipschitzness of vg is based on the fact that 
Vl{x) > go[snp{t{x, a) : a G A}], where go is the uniform lower bound for 
(7 in (PJ. The following example shows that |(5J cannot be deleted from the 
hypotheses of this proposition. It illustrates how relaxing the uniform lower 
bound on g gives phenomena not found in the Zubov equation solutions in 
[S] (see also Remark 

Example 4.5 For each fc G No := {0, 1, 2, 

tk- = 10'^ ^ 
Define I a and A : /a — 



/a = U [tk-,tk+] , A(a:;) = 




tk- <x< 10'=, fc G No 
lO'' < 2; < tk+, /c G No 



Then the graph of A is a sequence of nonoverlapping triangles centered at 
the points 10*^ for A; G No which become taller and thinner as A; +00. In 
fact, while 

A(10'^) = lO*^ 
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for all fc S No, we have 

/ A(x)dx = -^10-^-<oo 

•'^^ k=Q 

Let Q : M ^ E be any continuous function that satisfies the following condi- 
tions. 

• Q EE A on /a, Q{x) = {^)^x^ for < a; < ^, and Q{x) > for all 
X > 

• NuU(Q) = {0,±ti-,±ti+,±t2-,±t2+,...}, and |Q(x)| < 1 for all x in 
comp(/A) 

• Q[[comp(/A)] is Lipschitz with Lipschitz constant £ < 1, Q is odd, 
and /[o_oo) Qi^) dx < oo 

We leave the easy construction of Q to the reader. The functions 

g{x) = -Q{x)f{xl /(x) = - 10-^-10 ^ 

satisfy with Lg > and Lf G (0, 6(^)^). Take / as the dynamics, 
with no controls, and g as the cost function. Then {Ai)-{A4) and [Aq]- 
{Ai) hold with / ULES, and (i) holds with parameters r = 9/10, C = 1, 
a = Lr ^ (10/9)^, s = 6, K = 7, and c = 9/20. We let cj){t,x) denote the 
trajectory for / and the initial value x. For all a; > 0, it follows that 

Therefore, if (5 > is given, and if we set vs{x) = 1 — e^''^^'^^\ then we get 
\Dvs{lQ^)\ = 5Q{IQ^) exp Qi^) dsj ^ +oo as fc ^ +oo. 

Therefore, while Vl is locally Lipschitz, there cannot exist S > such that 
vs is globally Lipschitz. This example shows that the positivity condition P)) 
cannot be omitted from the statement of Corollarv l4.4l 



4.3 Uniqueness of Viscosity Solutions of Generalized 
Zubov Equation 

For any function w : (— oo,+oo], we define the Kruzkov transfor- 

mation w : ^ R of by w{x) := 1 — e^™(^\ with the convention that 
e~°° = 0. If w is a solution of the auxiliary PDE (|17|l on T>o, then i& is a 
solution of the generalized Zubov equation ^ on Do (cf. Chapter II). 
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We apply this observation to Vl , assuming for the rest of this subsection that 
the hypotheses of Corollary 14. II are satisfied. 

RecaU that dom(y£) = Vl{= V). Since V£{x) +00 as x -> d{Vl) 
and V[ is continuous on V^, V[ is continuous on R^. One can check (cf. 
that V£ satisfies the Dynamic Programming Principle 

V[{x)= sup {[l-Gix,t,a)]+Gix,t,a)V[i4>{t,x,a))] Vi > 0, 

o^eA'- (30) 
Gix,t,a) := e-"'[9l(^,*>") 

on M.^ . Using (|30() . one can use the arguments of |3I to show that V[ is a 
viscosity solution of the generalized Zubov equation on all of M^. Also, 
and (^7) give 

VLm,x,a)) < [l-Gix,t,a)][VLm,x,a))^l]+VLix) < VLix) 

for all X e Vo \ {0}, a e and i > 0, since V[ = Vt on (cf. igSJ). 
Therefore, Vl is also a robust Lyapunov function for fonVo- 

Now let w : M be any solution of (jU on that satisfies (S'C„). 

By applying Theorem ^ with £ = —g and h = g, we conclude that w agrees 
with 

/•oo 

VL(a;) = sup / G(a;,i,Q;)5(0(i,x,a),a(i))di gE (31) 
Jo 

on the asymptotically null set Pq- In fact, if we also assume that w is 
bounded, then = on all of R^. To see why, we can assume w is 
continuous, the general case being proven in a similar way. First note that 
by the boundedness of w and {SCw), 

Yon G{x,t,a)w{(j>(t,x,a)) Va G A Va; G E^ (32) 

which follows by separately considering the cases where the exponent 

/ 5(<A(s,a;,a),Q;(s))ds 
Jo 

converges or diverges and using g quasi-stability. An application of the first 
part of Lemma l2.4l (5(7^), and H32(l then gives w{x) > J[g,g]{x, +00, a) for 
all a G ^ and x G R^, so w{x) > Vl{x). On the other hand, given e > and 
X G R^ , the construction in the proof of Theorem ^ gives an input a ^ A 
such that 

— w{x) > — / G{x,s,d) g{(j){s,x,a),a{s))ds 
Jo 

— G(a;, t, a) w(0(i, x, d)) — e(l — e~*) 
for alH G N. Combining this and (|32|l now gives 

w{x) < J[g, g]{x, +00, a) + e < VL{x)+e, 
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as needed. Recall that is a continuous bounded viscosity solution of 
^ on which is null at the origin. Setting w = V£ in the preceding 
argument therefore allows us to conclude that V[ = Vl on all of R^, so Vl is 
also a continuous solution on . The following corollary summarizes these 
observations and includes the global uniqueness results for the generalized 
Zubov equation in [Hj. 

Corollary 4.6 Assume {Ai)-{A4) and {A(i)-{As) with / ULES. Then: 

(1) Vl is a robust Lyapunov function for / on Do, and Vo — V^^([0, 1)). 

(2) If w is a solution of on T>o satisfying (SCw), then w = Vl on 2?o- 

(3) If w is a bounded solution of ^ on satisfying (SCw), then w = Vl 
on M^. 

Moreover, (i) Vl is the unique bounded solution t« of on that satisfies 
(SCw) and (ii) Vo = w^^([0, 1)) for any bounded solution t« of on M.^ 
that satisfies {SCw)- 

Remark 4.7 In Example IlTI {Ai)-{A4) and {Ae)-{A7) hold, but (As) is 
not satisfied, and there are infinitely many bounded solutions of ^ on M.^ 
satisfying (SC^)- Therefore, the quasi-stability hypothesis (Ag) of Corollary 
14.61 cannot be dropped. 

Remark 4.8 Conclusions (2)-(3) of the preceding corollary remain true if 
(Ag) is replaced by (|19|l . We can also prove 'nonglobal' PDE characteriza- 
tions for solutions of on general open sets O under our relaxed conditions 
on g (cf. Appendix B). The paper ^ suggests the problem of determining 
what subset of the set of all robust Lyapunov functions V for a given ULES 
dynamics / has the following properties: (i) V = VlIq] for some cost func- 
tion g and (ii) V is the unique bounded solution of the generalized Zubov 
equation that is null at the origin. One consequence of our results is that 
by allowing more general costs g, we made the subset of known Lyapunov 
functions satisfying these two properties strictly larger. In particular, the set 
of Lyapunov functions Vl [g] studied in |H| is a proper subset of the set of 
all functions that can be written as unique solutions of generalized Zubov 
equations. To see why, we have to find robust Lyapunov functions V which 
can be written as Vl [g] for cost functions g satisfying our standing hypothe- 
ses, but which cannot be written as VL[g] if g is also assumed to satisfy the 
positivity condition which is assumed in ^ El |H1 • A general method 
for doing this is as follows. 

Let / be a ULES dynamics satisfying {Ai)-{A3) and Br C Vo, and g 
satisfy the standing hypotheses in such a way that g{x, a) = j{x) and 7(2;) = 
for some x ^ Vo \ Br (cf. fJ3 for particular cases). In particular, this 
means 7 is locally Lipschitz (cf. {Aq)). Then g does not satisfy the positivity 
condition ||2Jl. Take W to be the associated Lyapunov function Vl[3], so 
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that 1 — = Then W is continuous on Do, and VL[g] is the 

unique bounded solution of Q on satisfying {SCw)- Suppose g satisfies 
the standing hypotheses and also the positivity condition |2Jl, and suppose 
further that W = VL[g] on T>o- Let L-^ > 1 be a Lipschitz constant for 7 on 
Bi{x), and pick e G (0,(7o), where go is from the positivity condition on 
g. Since / is bounded, we can find t > such that 



_ s 
(s, a;, a) — a;| I < — A 



A 1/2 Vs e [0,t], Va e X 



Using the Dynamic Programming Principle H21|) for W = Vl [g] , we can find 
a sequence a„ G so that 

W{x) - W{i>{t, X, a„)) < J\g\(x, t, «„) + -. 

n 

A reapplication of Lemma l2.1l on the sequential compactness of H21(l . and 
the fact that W = VL[g] = V[[g] = VL[g] = V[[g] on Vo then give a e A'' 
such that 

got < / g''i(j}{s,x,a),a{s))ds 
Jo 

< W{x)-W{(l){t,x,a)) 

< / Y{4'is,x,a))ds 
Jo 

< tL^ max{ I |(/)(s, x, a) — I : < s < t} < te, 

contradicting the choice of e. This shows that V :— 1 ~ satisfies the 
requirement. 

Remark 4.9 Notice that Corollary 14.51 applies to cases where Q is not 
satisfied, and which therefore are not covered by For example, take any 
bounded ULES / and 



gix,a) = 



\\x\\<r 



l+r r 
1 



\x\\ > r 



where r is the constant in the ULES definition, in which case the g quasi- 
stability of is easily shown. In this way, Corollary 14.61 generalizes the 
uniqueness results of ^6 on by establishing stronger conclusions that also 
cover a larger class of cost functions g. Moreover, Remark 14.81 shows that 
Corollary 14.61 gives PDE characterizations for a strictly larger class of Lya- 
punov functions than is covered by 0. 

Remark 4.10 Recall that by the "/C£-Lemma" (cf. JH]), each /3/ e ICC 
admits ai.a^ G JC°° such that 

/3/(r,t) < a2(ai(r)e-*) Vr, i > (33) 
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The results we gave in this note remain true if we replace the assumption 
(|19|l with the condition that there be positive constants e and 5 such that 

<g{x,a) < 6a^\\\x\\) y{x,a)eB^xA (34) 

and relax the ULES assumption to the requirements that (i) / is ULAS and 
(ii) the requirement (★★) holds for /?/ g ICC satisfying (and keep the 
rest of the assumptions the same). Condition H34|l is used in 0] to study the 
Zubov equation for ULAS dynamics, but under the extra conditions (O and 
{Aq). (In 0, / is assumed to satisfy a more general ULAS-like condition, 
involving a general compact attraction set D instead of the origin. The 
arguments we gave above can be adapted to this slightly more general case.) 
Notice however that the results we gave on verification functions w in S]3| (for 
£ — ~g) remain true for general asymptotically null dynamics, even if H34|l is 
not assumed (cf. Remark l2.6|l . 

5 Illustrations 

This section illustrates our results by revisiting a simple example from [H], 
where the ULES dynamics is 

f{x,a) = {-xi+ax\,-X2 + axl), (x, o) £ x [-1, +1] (35) 

(We can take / = outside a suitable set containing (— l,+l)^x^to bound 
the dynamics.) If we choose g{x) — ||a;|p, then the positivity condition (O 
on g holds, and ^ shows that 




— ln(l — xi) — ln(l — X2) — xi — X2, Xi > —Xi 

- ln(l + xi) - ln(l + 2:2) + + a;2, x\ < -X2 



on D = Do = (—1, 1)^. By 6 , this function is the unique continuous positive 
solution of 

X ■ Dw{x) - \xl{Dw{x))i + xl{Dw{x))2\ - \\x\\^ = (36) 

on Do that satisfies 

(SCw), w is bounded-from-below, and w{x) — > +c>o as x — > d{T>o) (37) 

On the other hand. Theorem |21 proves a stronger result, namely, that Vl is 
in fact the unique solution of (|36|) on 2?o in the class of functions w : Do ^ M 
that satisfy (|37|l . In particular, there are no discontinuous solutions of H36() 
on Vo that satisfy (jSTji . 

Our results also apply to more general cases. For example, change g to 



g{x,a) = ||x|p^(a;), where ^'(a;) = ^y\xi - 3/A\ + ^\x2 - (38) 
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By Corollary Ol and the fact that *(a;) > |a;i - || + |a;2 - || for all x G T>o 
with xi,X2 > 0, one shows that the Lyapunov function Vl[3] still satisfies 
(1^ . and VL[g] is still a robust Lyapunov function for / on Vo (cf. J,). Also, 
Vl [g] is still a solution of 

x-Dw{x) ~\xliDw{x))i+xl{Dw{x))2\-\\x\\^'^{x) = (39) 

on 2?o, and it is the unique solution of this equation on Do that satisfies (|37|l . 
by Theorem|5] Since the Dynamic Programming Principle still holds on R^, 
Vl [g] is the unique bounded solution of the generalized Zubov equation 

\\x\\^-i'{x)[w{x)-l]+x-Dw{x)~\xl{Dw{x))i+xl{Dw{x))2\ = (40) 

on that satisfies (SCw) (cf. |3| and H4.3|) . Since the Lipschitz and posi- 
tivity conditions on g are no longer satisfied, these results do not follow from 
the known results. The preceding results remain true if \1/ in ()38|l is replaced 

by 

^'(a;) = |xi-3/4| + |x2-3/4|. 

More generally, for any g : x [— — > [0, oo) satisfying the standing 
hypotheses, we get a maximal cost type robust Lyapunov function Vl for 
1)35(1 and corresponding PDE characterizations for Vl, Vl, and Pq. 

6 Conclusion 

This note analyzed a class of explicit robust Lyapunov functions of maximal 
cost type for uniformly locally asymptotically stable dynamics. These Lya- 
punov functions were shown to be unique viscosity solutions of first order 
equations, subject to appropriate side conditions. The Kruzkov transfor- 
mations of these Lyapunov functions are unique solutions of the generalized 
Zubov equation introduced in |H] . Since we allowed general cost functions 
g, these uniqueness results do not follow from known results on first-order vis- 
cosity solutions. The uniqueness characterizations were used to give sublevel 
set characterizations for the robust domain of attraction. As a byproduct, we 
gave new PDE characterizations for the variable interest rate infinite horizon 
minimal cost function for cases where the Lagrangian could be negative, in- 
cluding the case where the discount rate is identically zero and the dynamics 
is unstable. This result is of independent interest, because it allows infinite 
horizon problems with unbounded cost functions where cost minimization can 
take place in one part of the state space while maximization takes place in 
the rest of the state space. One could consider the question of what subset of 
the set of all robust Lyapunov functions can be expressed as unique solutions 
of Zubov PDE's. As shown in Remark 14.81 our allowing general nonnegative 
g increased the size of this subset. One could also consider the question of 
how the numerical analysis of the generalized Zubov equation for positive 
cost functions g (cf. |3]) can be extended to the case of general nonnegative 
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g, and in particular, how allowing degenerate costs g affects the computation 
of the sublevel set Do = Vj^^{[0, 1)). Research on these questions is ongoing. 

A Appendix: Quasi- Stability and Existence of 
Nearly Optimal Trajectories 

This appendix proves the following results on quasi-stability and nearly- 
optimal trajectories used in i) ii3l4l 

Proposition A.l Let {Ai)-{A4) and (Aq) hold and O C M^. Then O is 
relaxed g quasi-stable iff O is g quasi-stable. 

Proposition A. 2 Let (Ai), (A2),(A4), and (A5) hold, with h = and 
Null(||/(0, OH) / 0, ^ C be /-invariant, and w : ^ R be a solu- 
tion of (O on \ {0} satisfying (SCw). Let x £ G, i ^N, and e > be given, 
and define the functions Ej by (|12(l . Then, 



contains an element of the form (1, a). 

We start by proving Proposition lA.ll which follows from the following 
special case of Theorem 1 in JHI '■ 

Lemma A. 3 Let A be a compact metric space, and let / be uniformly 
locally Lipschitz (cf. (A2)). Let x e M^, let a £ he such that (/){■, x, a) 
has domain [0, 00), and let r : [0, 00) — » (0, 00) be continuous. Then there 
exist f3 £ A and rf e 5^(0) (a^) such that \\(j){t,x,a) — (j){t,r]° , /3)\\ < r{t) for 
all t > 0. 

To prove Proposition lA.ll we adapt the idea from ^Hl of putting an 
approximating trajectory in a tube around the reference trajectory which 
has a vanishing radius, along with an augmentation of the dynamics used in 
[7] . Extra care is taken to make sure that not only the reference trajectory is 
approximated, but also the integrated cost of the trajectory is approximated. 
The details are as follows. Let O C R^ be open. If O is relaxed g quasi- 
stable, then it is also g quasi-stable, since as we remarked above, A C A^. 
Conversely, assume O is g quasi-stable and x G C Let a E A^ he such 
that J[g]{x, +00, a) < +00. The proposition will follow once we show that 
(j){t, x,a) ^ a.s t ^ +QO. We apply Lemma FA . 31 with the choices 



{ 



{t,a) : <t < 1, a £ A, w^,{x) > /J £{4>{s, x, a), a{s)) ds 
+Wi,{(l){t,x,a)) - Et{t) 
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and the augmented dynamics 

< , ae A (42) 

Notice that the trajectory for (|42|l . a G , and any initial position {x,y) 
has the form ^ 

(j){t,x,a), y + J g''{<j){s,x,a),a{sj)ds 

Using the initial value (a;, 0) £ M^+^, Lemma [A.SI gives an input (3 ^ A and 
an initial value 7]° — (?7£,?y^) 6 M^"*"^ satisfying 



mt,7jl,P)-<Pit,x,a)f + 



Vr+ / 5(0(5, r?£,/3),/3(s))ds 



g^{(j){s, X, a), a{s)) ds 
< r^{t) Vt > (43) 







In particular, ||?7£ — a;|| < dist(x, 90)72, so rjl G O. Since g is nonnegative, 
(O gives 

gm,vhP).m)At < \v'h\ + Cg'^m,x,a),ait))dt < ^. 

Since O is g quasi-stable, we get 

(j){t,'r]1, P) ^ as t — > +CX), 

so gives 

||0(i,a;,a)|| < ||0(t, x, a) - 0(i, ry^, /3)|| + ||0(i, Ty^, /3)|| 
< e-* + ||(/.(t,77£,/3)|| ^ as i^cx3, 

as needed. 

We turn next to the proof of Proposition IA.2I which is a generalization 
of the proof of the theorem of |^ . We assume w is continuous and i = 1 , 
the general case being similar. (See Theorem 12 for the justification for this 
continuity assumption.) Note that Zi is partially ordered by 

(ti,ai) (t2,a2) iff [ii < i2 and Q;2[[0,ti] = ai a.e.] (44) 

Since G is /-invariant, the argument from ^2 shows that every totally or- 
dered subset of Zi has an upper bound in Zi. (If {{tj,aj)} is totally ordered 
in Zi, then its upper bound in Zi is (i, a), where t = sup^ tj and a{t) := aj{t) 
for a.e. t G [0,tj].) It follows from Zorn's Lemma that Zi contains a max- 
imal element {i,a). We will now show that t — 1. We can assume that 
(j){i,x,a.) ^ (since i{0,a) = w{0) — and /(O, a) — for some a G A). 
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Since G is /-invariant, (j){t,x,a) G Q. Let B be an open set containing 
(/)(<■, X, a) whose closure lies in ^ \ {0}. Suppose that i < 1, set g := 4>{t, x, a), 
and pick 5 e [0, dist(g', 9i?)/2). Since / is bounded, it follows that Ts{q), as 
defined in 0, is positive or -t-oo. By the second part of Lemma im it follows 
that there is a i e (0, 1 — i ) and a, (3 G A so that 

w{(j){t, X, a j) > / £{(j){s,(j){i,x,a),P),P{s))ds 
Jo 

+ w{cj){t,cj){t,x,a),pj) (45) 
- Ei{t + t) + Ei{t) 

and so that (j){s,(j){t,x,a), (3) € B for all s e [0,t]. Let /?" denote the con- 
catenation of Q;f[0,t] followed by the input (3. If we now combine (|45|l with 
the inequality in H41|l with the choice a — a, then we get 

rt+t 

w{x) > / £{(j){s,x,(3^),P^is))ds + w{(l){t + t,x,(3^)) ~ Ei{t + t). (46) 
Jo 

Since t was chosen so that t -f- i < 1, we conclude from (|46|l that 

(i + i,/3») eZi. 

Since /S' is an extension of a, this contradicts the maximality of the pair 
(F, a). Therefore, t = 1. This proves Proposition IA.2I and completes the 
proof of Theorem^Jfor h = 0. The proof for general h is similar. 

Remark A. 4 It should be emphasized that Lemma FA. 31 is not an extension 
of the Filippov-Wazewski Relaxation Theorem, since the original and approx- 
imating trajectories are allowed to have different starting values. Theorem 1 
in |1(J| is stated in terms of time-dependent differential inclusions x S F{t, x). 
To get Lemma Fa. 31 from this theorem, first take F{t,x) = f{x,A), so 

co{F{t,x))=rix,An. 

The hypotheses of the theorem are satisfied since we are assuming that / is 
locally Lipschitz and A is bounded. The theorem allows us to approximate 
any solution x oi x G co{F{t,x)) by a solution y oi y G F{t,y) in such a 
way that \\x{t) — y{t)\\ < r{t) for all t > 0. Now take a G A^ and apply the 
preceding to the solution x{t) :— (j){t,x,a) of i £ co{F{t, x)). Since the sets 
A{t) := {a G A : f{y{t),a) = y{t)} are measurable, Filippov's Lemma gives 
an input (3 G A such that ?/(•) = , rj" , P) , where rjo G Br^Q){x), which gives 
Lemma I A. 31 

B Appendix: Nonglobal Solutions of Zubov 
Equation 

In 521 we gave global uniqueness characterizations for solutions of the PDF 
on M^. As pointed out in it can be inconvenient from a practical point of 
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view to verify that a function is a PDE solution on all of M''^. This motivates 
the problem of finding nonglobal uniqueness characterizations for solutions 
of (Q, on general open sets O C R^. For simplicity, we will assume T>o C O. 
The following nonglobal uniqueness characterization extends the results of [B] , 
§3, to general continuous g. The proof is a localization of the argument used 
to prove TheoremlD Recall that if F : x M x ^ M is continuous, then a 
locally bounded function w : O — > M is called a (viscosity) supsersolution 
(resp., subsolution) of 

F{x,w{x),Dw{x)) 

on O provided that (Ci) (resp., (C2)) of Definition 12.21 is satisfied. We will 
use the fact (cf. that if (Ai)-(A5) hold, then any subsolution (resp., 
supersolution) of ((HJ on a bounded open set B satisfies conclusion (a) (resp., 
(b)) of Lemma in 

Proposition B.l Let {Ai)-{Ai) and {Ag)-{As) hold with / ULES. Assume 
that O C is open, Vo C O, and w : cl(0) R is bounded. 

(i) If w is an upper semicontinous function which is a subsolution of 
on O satisfying w{0) < and w = 1 on d{0), then w < Vl[(?] on O. 

(ii) If w is a lower semicontinous function which is a supersolution of 
on O satisfying w{0) > and w > 1 on d{0), then w > Vl[.9] on O. 

Proof, (i) By the proof of Theoremn(with £ = ~g and h = g), w < VL[g] on 
T>o- Let X € O XVo- It remains to show that 

w{x) < VL[g]ix). 

Assume the contrary and pick e > such that 

w{x)>VL[g]{x) + e (47) 

Define the functions by for i e N. Set 0(0) = x, and 

Jwix, t, a) — G{x, t,a) — 1 — G(x, t, a)w{4>{t, x, a)) 

wherever the RHS is defined, where G is as defined by (jSOJ. We will induc- 
tively define the sets 

_/ (<,a) e [0, 1] X yl: (/)(s,0(i),a) G O Vs G [0,i], 
1 -w{x) > JMi),t,a) - ^E,+,{t) 

for all i € No- The set Zq i is partially ordered by ~ as defined in (|44|l . Let 



f :={(t„a,)} 
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be a totally ordered subset of Zos- If 4'{tj7X, aj) converges to point in d{0), 
then the semicontinuity of w implies that — — e majorizes 

_ s 

— w{x) > G{x,tj,aj) — 1 — G{x,tj,aj)w{(j){tj,x,aj)) ~ — 

> G{x,tj,aj) - 1 - G{x,tj,aj) (l + |) ~ | 

> (48) 

for large j, so VL[g]{x) < 1 — e/4. Therefore, x G dom(yt[5]) = ^'o- This 
contradicts the choice of x. By the proof of Proposition it follows that 
T has an upper bound in Zq.i (cf. 17 ). By Zorn's Lemma, Zq^i contains a 
maximal element (t, a), and the proof of Theoremn(with £ = —g and g = h, 
applied to the supersolution —w of the Hamilton- Jacobi equation (|SJ)) shows 
that t = 1. Now set 

^(1) = a). 

The preceding argument gives a maximal element (1,0:2) G Zo^2- (To show 
that each totally ordered set of (sj , q;j_2)'s in 2^0,2 has an upper bound in 
Zo,2, notice that if 0(sj, (^(1), q;j_2) — > p G d{0) for some p G M^, then 
with tj and aj replaced by 1 + Sj and the concatenation of a followed by 
aj,2, respectively, gives the same contradiction as before.) Set 

0(2) = 0(1, 0(1), 02). 

This procedure is iterated exactly as in the proof of Theorem ^ and gives an 
input a G A such that 

w{x) < l-G{x,M,a) + G{x,M,a)w{(l}{M,x,a)) + ^ VM eN 

and such that (j){t, x,a) G O for all t > 0. A reapplication of H32|) gives 

w{x) < l-G(x,+oo,a) + | < Vi[g](x) + |, 

which again contradicts the choice of e > in 1471) . Therefore, 

w{x)<VL[g]{x), 

which proves (i). 

(ii) Let X G C For any a £ A, define the exit times 

i{x, a) := m{{t > : 0(i, x, a) ^ O} e [0, +00] 

A repeated application of the first part of Lemma [2.41 with £ = —g (cf. \14\) 
gives 

w{x) > 1 ~ G{x,t,a) + G{x,t,a)w{(j){t,x,a)) Va e A (49) 
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for all finite t € (0, i{x, a)]. If i{x, a) is finite for some a € A, then (|49|l with 
the choice t = i{x,a) gives 

w{x) > 1 > VL[g]{x). 

Otherwise, H32|) and a passage to the liminf as < ^ +oo in H49|) for fixed a 
gives 

w{x) > 1 — G{x, +0O, a) 
for all a G A, so 'w{x) > VL[g]{x), as needed. I 

Remark B.2 If we put (i)-(ii) of the previous proposition together, then we 
get nonglobal PDE characterizations for Vl[(?] which extend the results of 
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